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1. INTRODUCTION 

Recently, one of the main challenging problems and active topics in the scope of artificial 
intelligence and pattern recognition is the recognition of face with rotation on different angles (from left to 
right side) [1]. A good recognition system of the face must be strong to exceed the changes in expressions of 
the face, poses, conditions of image, and illumination [2], [3]. In verification or identification, building 
automated human face recognition systems able to recognize faces is a true challenge [4]. Faces can be 
viewed in different angles (different rotation), expressions, and hair which can change the face; there is a 
similarity between different faces [5]. A general face recognition (FR) system has three stages: detection; 
feature extraction, and recognition [6], [7]. Face detection process is used as an important feature in many 
applications in image analysis and biometric systems [8]. It can be used for security systems, for 
authentication in comparison to secured ID cards or passwords that are suitable to its reliability [9]. In image 
classification and face recognition systems, supervised learning is used by providing the sample set of data to 
build and store a dataset to be used in comparison [10]. Also, they keep each pre-processed human face in a 
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database and extract the unique features from the face to compare them with the features in the database [1]. 
In the FR system, there are two sets of data: the first is the training set of data that is used to enroll the dataset 
in the learning stage [7]. The second is the testing set which is used during the recognition phase [6]. In this 
paper, faces are detected and recognized from different angles and quite a large database using low-cost 
desktop embedded computing. The paper rest is ordered in several sections. Section 2 presents related works. 
Section 3 illustrates the contribution of the proposed recognition system (RS). Section 4, describes the file 
exchange interface (FEI) database. Section 5 describes the proposed RS with each step. Section 6 provides 
details of the experiment and the results of our system. Finally, section 7 reviews the conclusions estimated 
regarding the potential usefulness of the proposed recognition system. 


2. RELATED WORK 

There are several technologies and algorithms related to face detection and recognition systems. 
Multimodal recognition of face-based principal component analysis (PCA), independent component analysis 
(ICA), and scale-invariant feature transform (SIFT) as a multimodal fusion with neuro-fuzzy (NF) has been 
described [11]. Feature extraction based on SIFT is used. The recognition ID is calculated based on the NF 
inference system. In [12], neuro-fuzzy and eigenfaces are illustrated in face recognition where a human face 
is detected based on skin area by using the Eigen value of face method, and the face is recognized by a neuro- 
fuzzy. In [13], a recognition system of the face is prepared using adaptive neuro-fuzzy inference with PCA. 
In [14] face recognition is proposed with a new method named convolution neural network (C2D CNN). In 
[15], Introduced a system of facial recognition established adaptive neuro-fuzzy inference. In [16], neural- 
fuzzy has been used in face recognition and back propagation (BP) algorithm used to update weights of the 
neurons. The network is trained for testing using two sets of the image to identify the person. In [17], shows 
how to eliminate the angular problem in face recognition by combining two mechanisms as a hybrid method 
in nature and combining advantages of them to reduce the accuracy of the false matching. 


3. CONTRIBUTION 

The paper aims to build a system to detect and recognize a face with 180-degree rotation. The paper 
also aims at checking the face during the database and augmentation the accuracy of recognition with 
different viewing conditions (frontal, profile, and near profile faces) under different conditions of several 
facial impressions. Our approach consists of two phases. The first one detects faces from the image with 
different angles and this means that the faces are detected with 180-degree rotation (from the left to the right 
side). The second phase after analysis of the facial image is the recognition stage to recognize the tested 
image using the PCA algorithm. This proposed system finds the nearest distance between the tested image 
and images stored in the database to identify a person. 


4. DATABASE OF FEI 

The FEI database is a database from Brazil that contains 200 face images of people, each of them 
with 14 different images. The total of images is 2,800. All of them are colored with a frontal and profile face 
rotation up to about 180 degrees. The same numbers of female and male subjects are equal to 100. Personage 
is between 19-40 years old with distinct hairstyle, appearance, and adorns. Figure | displays samples of faces 
image of persons in the database with different rotation and viewing [16]. 


5. PROPOSED FACE RECOGNITION SYSTEM 

Face recognition has several steps, each step of face recognition completing the previous steps. They 
can work separately depending on the regular system. Figure 2, shows the general recognition system [17]. 
To get recognition automatically, a database of a face image with information about each face is essential to 
build. The features are extracted and stored in the database for each person. Then, detection of the face and 
feature extraction is performed using Viola-Jones on the input image. Figure 3 illustrates the methodology of 
the proposed FR system. 


5.1. Preprocessing 

The preprocessing phases in this paper consist of two stages that seek to enhance the visual 
appearance of the image [18]. The first stage, which is image transform to grey level by transforming the 
three components of the color image RGB bands into one band, will be noted as grey as shown in (1) [19], 
[20]: 
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Grey(i,j) = 0.2989 R(i,j) + 0.5870 G(i,j) + 0.1140 BGi,j) (1) 
where, R, G, B are the color components that correspond to the red, green, and blue bands of the image and 
are converted into newly band called gray band that represents the intensity component of the colored image 
[21], [22]. The resulted intensity image contains all the image features that may be useful for face detection 
and recognition processes [23], [24]. Gamma correction is the second stage in preprocessing, performing a 
non-linear operation on the pixels of an input image. It can cause the image saturation to be modified. If the 
gamma value is too small or large, this will lead to reduced contrast using (2): 


Grey = C X valuegamma + black level (2) 


where C is set by the monitor Contrast control and the black level is set by the check Brightness control. The 
value refers to the pixel level normalized to a maximum of 1. The link is linear if gamma=1. 
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Figure 1. Samples of FEI database [16] 
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Figure 2. General structure of a face recognition [17] 


5.2. Training and face detection 

In this phase, the input image is load and the face is detected with different rotation (frontal and 
profile faces) using the Viola-Jones algorithm that is considered one of the main public algorithms in face 
detection. Efficient features have been extracted to detect faces from the input image. These detected faces 
are used in the recognition phase. The first important step of the recognition of faces is the accurate detection 
of human faces. Therefore, some faces in a given arbitrary image will be found. Returning image location 
and area of each face refers to the main goal of the face detection phase. Figure 4 shows the steps of the 
Viola-Jones algorithm. 
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Figure 3. Diagram of proposed FR system 


The features are evaluated in the Viola-Jones algorithm by using the base window size is a 24x24 
window in any given image. More details are presented in [25]. The detected face is rectangular with a 
specific color. Figure 5 illustrates examples of detected sample image faces from the FEI database with a 
different angle (from left to right rotate), various facial expressions, poses, and low execution time. 


Haar Features Integral Image Adaboosting Cascading 


Figure 4. Flowchart of Viola-Jones algorithm [25] 


5.3. Face recognition based on PCA 

An ER system has to bind for each face with an identity or name that comes across by corresponding 
it to a large database of persons [23]. PCA is used in the recognition phase, as a multivariate analysis in 
which correlated variables can be transformed into a minimal number of uncorrelated variables called 
principal components (PCs). PCA algorithm solves the recognition problem within a representation area of 
lower dimension than image area. The dimensionality of the original data space is decreased simplifying a 
dataset by using PCA as an Eigenface. More details are found in [22]. The main steps in using PCA are [24]: 
— Taking the training set of face images, rl r2............ rN. 
— Computing the mean of face image average by using (3). 


w= 2YR Ry 3) 


Calculating the difference between each image face and the mean by using (4). 
G; = R; =H (4) 
— Determining of the covariance matrix by the following relation: 
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C =—YN_,G,G] = AAT (5) 
— Calculating Eigen vectors and Eigen value, A=[v1, v2, v3,....., vd] , 
V1 ‘aieie 0 
V=}i «= 3 (6) 
0 ware Vis 


Figure 5. Training detected face images with 180 degrees rotation 


— Computing Euclidian distance between the tested image and every other training image in the database. 
If V refers to the feature vector of the test image, n is the number of used feature, and that of the 
database which is D; then, a match is found by minimizing the Euclidean distance: 


Euclidean distance = ./)'"_,(D, — V;)2 ) 


6. EXPERIMENTAL RESULTS AND ANALYSIS 

The experimental result of the proposed FR system is implemented in a laptop with RAM 8.0 GB, 
CPU Intel(R) core 17, and the programming language is Visual studio C#. MS-Windows platform is used to 
make the application program. Figure 6 shows the interface of the proposed FR system with an example of 
the face detected and stored in a database. The results of the proposed algorithm have two phases: training 
and testing. In the training phase, the proposed FR system recognized the human face while the test set of an 
image cannot be recognized by the proposed FR system because they are not in the database of the system. 
To get better recognition accuracy of the proposed FR, it is recommended to increase the number of features 
extracted from the face image and used as a database. In this paper, the original size of images taken from the 
FEI database is 640x480. Each image is converted to gray and enhanced by using (1) and (2) respectively as 
shown in Figure 7. The face is detected by the Viola-Jones algorithm and resized by 100x100 pixels; 
then, the face is cropped to be trained and stored in a database with the name of a person as shown in 
Figures 6 and 7 respectively. The Eigenfaces of these trained faces with input tested face image are 
determined by the PCA algorithm to be recognized as a face. Euclidean distance measurement was calculated 


by (7). 
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Time Executed: 


Results: 
Time Executed: 339ms/ 


Persons present in the scene: 


Figure 6. Proposed FR system interface 


Original image Cropped & Resizing image 


Figure 7. Grey-enhanced-resized face image 


To evaluate the performance of our proposed FR system and analyzing this paper, two sets of the face 
image are used from the FEI database as training and testing sets. The face recognition (FR) system 
performance evaluation is done by using these two kinds of sets. The test images are utilized by the trained 
PCA to determine the percentage of error and accuracy of the proposed FR system. A 35 set of face images 
are used as training images to train the system. Each one of them has 14 sample images with different 
rotation (rotate 180 degrees) as shown in Figure 1. A set of 15 face images are used as a testing image. The 
person's faces can be recognized and the information is obtained from the database of our system. The 
execution time is shown in seconds. The tested images and recognized faces are shown in Figures 8 and 9 
respectively. 

The experimental recognition results of the 50 face images with execution time are shown in 
seconds in Table 1. These experimental results are analyzed to get the accuracy of recognition and the 
performance of our FR system as shown in Table 2. The recognition rate is the ratio of successful test images 
(the best match cases is the correct match) to the total attempts. Total recognition accuracy (RA) of 96% as 
shown in Figure 10(a) which is an acceptable score is calculated for various facial expressions and poses of 
the proposed face recognition system by using the (8). 


No of image recognition correctl 
RA= eee Xx 100% (8) 


Total number of test images 


Figure 10(b) shows the average time execution for both trained and tested images where the average 
time execution for 35 trained images is (0.323657s). For tested 15 images, the average time is (0.3348s) that 
indicates to low execution time in detecting and recognizing process. This gives strong success and high 
accuracy for both trained and tested images in using the proposed method for facial recognition as shown in 
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Figure 10(c). For future work, the system could be converted and rebuilt as a website similar to the website 
presented in [25] to be more active and upload a database built on the server to access from any place 
connected with the database. 


Display Faces Detected: 


Time Executed: 


Name: 


Results: 
Time Executed: 371ms/ 


Persons present in the scene: person33, 


Figure 8. Test image and face recognition 


Figure 9. Examples of test images and face recognition with various face expressions, poses 
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Name Type Results Time (second) Name Type Results Time (second) 
Person! Train Recognized 0.296 Person 26 ‘Train Recognized 0.356 
Person2 ‘Train Recognized 0.325 Person27 ‘Train Recognized 0.388 
Person3 Train Recognized 0.246 Person28 Train Recognized 0.328 
Person4 Train Recognized 0.312 Person29 ‘Train Recognized 0.291 
Person5 Train Recognized 0.240 Person30 ‘Train Recognized 0.410 
Person6 —‘ Train Recognized 0.282 Person31 —‘ Train Recognized 0.292 
Person7 Train Not Recognized 0.303 Person32 ‘Train Recognized 0.271 
Person8 Train Recognized 0.305 Person33 _— Train Recognized 0.362 
Person9 = Train Recognized 0.300 Person34 ‘Train Recognized 0.259 
Personl0 Train Recognized 0.402 Person35 ‘Train Recognized 0.316 

Person 11 = Train Recognized 0.321 Person 36 Test Not Recognized 0.318 
Personl2 ‘Train Recognized 0.333 Person37 Test Not Recognized 0.294 
Personl3 Train Recognized 0.369 Person38 Test Not Recognized 0.330 
Personl4 Train Recognized 0.365 Person39 Test Recognized 0.383 
Personl5 Train Recognized 0.296 Person40 Test Not Recognized 0.245 
Personl6 Train Recognized 0.286 Person41 Test Not Recognized 0.323 
Personl17 — Train Recognized 0.301 Person42 Test Not Recognized 0.335 
Personl8 Train Recognized 0.269 Person43 Test Not Recognized 0.302 
Personl9 Train Recognized 0.430 Person44 Test Not Recognized 0.331 
Person20 ‘Train Recognized 0.369 Person45 Test Not Recognized 0.319 
Person 21 Train Recognized 0.403 Person46 Test Not Recognized 0.305 
Person22 ‘Train Recognized 0.325 Person47 Test Not Recognized 0.277 
Person 23 Train Recognized 0.356 Person48 Test Not Recognized 0.298 
Person24 Train Recognized 0.423 Person49 Test Not Recognized 0.302 
Person 25___ Train Recognized 0.255 Person50 Test Not Recognized 0.66 
Total Recognition Accuracy 96 % 
@ Total Recognition 
Accuracy % 96 
Average time (seconds) 
(a) 
0.3348 0.3236 93.335 97.143 


Tested 


Trained 


Images (15) Images (35) 


Type Image 
(b) 


Tested Images 
(15) 


Trained Images 
(35) 


Type Image 
(c) 


Recognition Accuracy % 


Figure 10. A total recognition accuracy with average time execution for both trained and tested images: (a) a 
total recognition accuracy, (b) average time execution, (c) recognition accuracy 


Int J Artif Intell, Vol. 11, No. 2, June 2022: 593-602 


Int J Artif Intell ISSN: 2252-8938 im) 601 


Table 2. Experimental results of face recognition rate 


Type image Number of images Recognition accuracy (%) Average time (seconds) 
Trained images 35 97.143 0.323657 
Tested images 15 93.335 0.3348 
Total recognition accuracy % 96 0.334771 


7. CONCLUSION 

This paper presents simple, easy, and fast human face recognition to detect the multi-angle sample 
face images from the FEI database with different rotation (from left to the right side), various facial 
expressions, and poses to provide a solution to the recognition problem. The preprocessing phase is achieved 
to enhance an image. Viola-Joens method gives a good result for face detection with different rotation and 
faces expressions. Principle component analysis algorithm is used for face recognition. The system will 
display the known person if one of the trained sets stored in the database matches the test image. It will 
display an unknown person if there is no match between the test image and one of the trained images in the 
database. The experimental results show the robustness and effectiveness of our system for face detection and 
recognition, achieving high total recognition accuracy of 96% and improving the recognition performance 
with low execution time for both trained and tested images. Furthermore, the accuracy of 35 trained images 
for recognition is 97.143% with average time execution that is (0. 323657 second). Also, the accuracy of 15 
tested images for recognition is 93.315% with average time execution that is (0.3348 second), which 
indicates a good and strong success and accuracy in using the proposed method for facial recognition. 
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